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ABSTRACT 



Purpose: The purpose of this study was to investigate the level of clinical image quality of panoramic radiographs 
and to analyze the parameters that influence the overall image quality. 

Materials and Methods: Korean dental clinics were asked to provide three randomly selected panoramic radio- 
graphs. An oral and maxillofacial radiology specialist evaluated those images using our self-developed Clinical 
Image Quality Evaluation Chart. Three evaluators classified the overall image quality of the panoramic radiographs 
and evaluated the causes of imaging errors. 

Results: A total of 297 panoramic radiographs were collected from 99 dental hospitals and clinics. The mean of the 
scores according to the Clinical Image Quality Evaluation Chart was 79.9. In the classification of the overall image 
quality, 17 images were deemed 'optimal for obtaining diagnostic information,' 153 were 'adequate for diagnosis,' 
109 were 'poor but diagnosable,' and nine were 'unrecognizable and too poor for diagnosis'. The results of the analy- 
sis of the causes of the errors in all the images are as follows: 139 errors in the positioning, 135 in the processing, 
50 from the radiographic unit, and 13 due to anatomic abnormality. 

Conclusion: Panoramic radiographs taken at local dental clinics generally have a normal or higher-level image 
quality. Principal factors affecting image quality were positioning of the patient and image density, sharpness, and 
contrast. Therefore, when images are taken, the patient position should be adjusted with great care. Also, standardizing 
objective criteria of image density, sharpness, and contrast is required to evaluate image quality effectively. {Imaging 
Sci Dent 2012; 42 : 183-90) 
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Introduction 

Dental societies in the U.S. and Europe stress the impor- 
tance of using a panoramic radiograph for surveying pati- 
ents, 1 ' 2 and quality assurance guidelines for panoramic 
radiography are continuously being published and revised. 3 ' 4 
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In 2001 in South Korea, a special law to establish a legal 
basis for medical imaging quality control was enacted. 
Based on the law, regulation on the installation and opera- 
tion of special medical instruments including computed 
tomography, magnetic resonance imaging, and mammo- 
graphy was enacted and published, which provided the 
legal groundwork for medical imaging quality control. 5 
However, continuous quality control of panoramic radio- 
graphy, a frequently performed exam in dentistry, is in its 
beginning stage. In 2009, the Korea Food and Drug Admin- 
istration initiated a study on the recommended radiation 
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dose in panoramic radiography, and it is considered the 
first step in dental imaging quality control. 6 

Quality assurance of dental radiography consists of the 
inspection of the personnel and facility, as well as image 
quality assurance. The image quality assurance inspection 
consists of a clinical imaging evaluation and a standard 
phantom image test. 7 Among the various types of image 
quality evaluation, clinical imaging evaluation is the most 
important inspection that enables actual and comprehensive 
evaluation since it reflects the entire quality assurance pro- 
cess, and it must be performed continuously. 8 

The panoramic radiographic unit uses both the principle 
of tomography and the principle of scanning. Characteris- 
tically, it may produce images that lack diagnostic value 
if the mandible and maxilla of interest are not correctly 
positioned in the focal trough. 9 

Recently, with the development of the image transmis- 
sion system and the wide use of digital panoramic radio- 
graphic equipment, the quality of panoramic radiographic 
equipment has improved 10 and consequently, a quality 
image can be obtained. 

As no appropriate guidelines on quality control have 
been prepared in South Korea, related studies are required. 
A certified inspection method is required to appropriately 
and effectively maintain and control the image quality, and 
studies on the current status of the panoramic radiography 
of local dental hospitals and clinics are prerequisites for 
such a certified inspection method. 7 

The purpose of this study was to investigate the level of 
clinical image quality for panoramic radiograph and to 
provide a basis for clinical image evaluation, which is the 
most important part of quality assurance in South Korea. 

Materials and Methods 

Collection of images 

Among the approximately 13,000 dental hospitals and 
clinics in South Korea, 260 (about 2%) were selected using 
the random sampling method, with the help of the Korean 
Dental Association. The 260 dental hospitals and clinics 
were asked to cooperate in the clinical image evaluation 
of panoramic radiographs. 

Each dental hospital or clinic was asked to provide three 
randomly selected radiographs. The image identification 
such as the name and sex did not accompany the radiograph 
to protect the patient's privacy. The file format of the radio- 
graphs was limited to JPG or DICOM and they were sent 
by email as an attachment. 



Training of clinical image evaluators 

To ensure a professional and efficient evaluation, oral 
and maxillofacial radiology specialists or clinicians who 
had been working in a hospital's Department of Oral and 
Maxillofacial Radiology for five years or more evaluated 
the clinical images. During meetings for the pilot study, 
14 evaluators were trained to evaluate panoramic images, 
and an agreement on the objective criteria for the qualita- 
tive evaluation of the images was forged among the eval- 
uators. 11 

Clinical image evaluation using a clinical image 
quality evaluation chart 

A chart was used to evaluate the image quality of a 
panoramic radiograph (Table 1). It was prepared during 
multiple meetings of evaluators. The perfect score in the 
clinical image evaluation was 100 points: 8 points for 
patient identification, 6 for artificial shadow, 8 for image 
coverage, 30 for patient positioning, 38 for image density, 
resolution, and contrast, and 10 for image quality grade. 

One of the 14 evaluators evaluated an image using the 
aforementioned chart and calculated the total score. Since 
all of the information on the patients, hospitals or clinics, 
and equipment were excluded during the data collection 
process, all of the images got a full mark for the parameter 
of patient identification. 

Classification of the overall image quality grade 

Three clinical image evaluators classified the overall 
image quality of the panoramic radiographs. The evaluators 
evaluated the image quality while viewing the images; and 
if there was any inconsistency between their evaluations, 
an agreement was made through discussion. The image 
quality grade was classified into the following 4 grades: 
1 . optimal for obtaining diagnostic information, 2. adequate 
for diagnosis, 3. poor but diagnosable/unrecognizable, 
and 4. too poor for diagnosis. The detailed criteria are 
shown in Table 2. 

For each image quality grade, the score was calculated 
according to the Clinical Image Quality Evaluation Chart, 
and scores of images that could be diagnosed were calcu- 
lated according to the image quality evaluation chart by 
comparing the maximum and minimum scores. 

Causes of imaging errors 

Apart from the scores calculated by the three clinical 
image evaluators based on the image quality grade, the 
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Table 1. Clinical image quality evaluation chart 

Score 



yes no 



1 . Identification Name of patient 1 0 

Sex 1 0 

Age 1 0 

Registration number 1 0 

Date of taking 1 0 

Time of taking 1 0 

Operator (name or mark) 1 0 

Mark for left or right 1 0 

2. Artifacts Internal artifacts or artifacts of unknown origin (record any stains, scratches, 4 2/0 

static electricity, or detector error, etc.): Not present/present but don't interfere with 
diagnosis/ may interfere with diagnosis) 

Artifacts caused by external factors (the patient's earrings, removable prosthesis, etc.): 2 1/0 
Not present/present but don't interfere with diagnosis/ may interfere with diagnosis) 

3. Coverage area Top: include the inferior border of the orbit 2 0 

Left: include outside of 0.5 mm to temporomandibular joint 2 0 

Right: include outside of 0.5 mm to temporomandibular joint 2 0 

Bottom: include underside of 0.5 mm to inferior cortical border of the mandible 2 0 

4. Patient positioning Bite block existence 2 0 

Occlusal plane: appropriate/flat/steep downward V-shape/ inverted V-shape 6 4/2/0 

Antero-posterior positioning: adequate/former or rear but diagnosis is possible/ 4 2/0 
unclear anterior portion 

Right-left symmetry: symmetry/The discrepancy is less than half of the width in 4 2/0 
M-D of mandibular 1st molar/ above half of the width in M-D of mandibular 1st molar 

Hyoid bone overlapped the mandible 2 0 

Patient movement (up and down): continuity on the inferior border of mandible 2 0 
(under 2 mm) 

Patient movement (up and down): continuity on the occlusal plane (under 2 mm) 2 0 

Patient movement (right and left): none of dual images 2 0 

Patient movement (right and left): none of disappeared images 2 0 

No soft tissue movement (evaluation of the soft palate, tongue and hyoid bone) 2 0 

5. Density, sharpness, Distinguishable dentinoenamel junction: almost distinguishable/indistinguishable 4 2/0 
and contrast of image in 2 of 6 of the regions/indistinguishable in 4 of 6 of the regions 

Distinguishable PDL space and lamina dura: almost distinguishable/indistinguishable 4 2/0 
in 2 of 6 of the regions/indistinguishable in 4 of 6 of the regions 

Accuracy of root shape: almost distinguishable/indistinguishable in 2 of 6 of the 4 2/0 
regions/ indistinguishable in 4 of 6 of the regions 

Metal artifact: distinguishable with secondary caries/ indistinguishable 4 0 

Extent of the proximal overlap: overlapped under the DEJ/ over the DEJ 4 0 

Homogeneity of the background density: homogeneous/heterogeneous 4 0 

Distinguishable alveolar crest in alveolar bone: almost distinguishable/ 4 2/0 
indistinguishable in 2 of 6 of the regions/ indistinguishable in 4 of 6 of the regions 

Distinguishable trabecular pattern in alveolar bone: almost distinguishable/ 4 2/0 
indistinguishable in 2 of 6 of the regions/ indistinguishable in 4 of 6 of the regions 

Regional contrast-TMJ area 2 0 

Regional contrast-maxillary sinus 2 0 

Regional contrast-mandibular area 2 0 

Noise: not present/present 2 0 

6. Overall image Optimal for obtaining diagnosis information/adequate for diagnosis/poor, 10 8/6/0 
quality grade but diagnosable/unrecognizable, too poor for diagnosis 



Total Score 100 

7. Cause of the errors Positioning errors during the radiograph taking (patient preparation, position of 
the mandible and maxilla, patient movement, and angle of the cervical spine) 
Errors from the radiographic unit and other mechanical errors accessories 
(irregularity of the exposure roller and error of the sensor and reader) 
Pre- and post-processing errors (enhancement errors, noise, and abnormal density 
and contrast) 

Errors due to anatomic abnormality (malformation of the mandible and maxilla, 
and congenital dental anomaly) 
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Optimal for obtaining diagnosis information High quality image providing sufficient information, with no errors from image taking 

procedure. 

Adequate for diagnosis Quality image providing sufficient information, with 1 to 2 error(s) from image taking 

procedure that does not affect the diagnosis. 
Poor, but diagnosable Diagnosable image, with some errors and partially unreadable region. 

Unrecognizable, too poor for diagnosis Poor quality image, with definite errors rendering the image diagnostically unacceptable. 



cause of the error observed on the image was determined 
and marked. The errors were classified into positioning 
errors during radiography (patient preparation, position of 
the mandible and maxilla, patient movement, and angle 
of the cervical spine), errors from the radiographic unit 
and other mechanical errors (irregularity of the exposure 
roller and error of the sensor and reader), pre- and post- 
processing errors (enhancement errors, noise, and abnormal 
density and contrast), and errors due to anatomic abnor- 
mality (malformation of the mandible and maxilla, and 
congenital dental anomaly). 

Results 

Image collection 

The images were collected from a total of 99 dental hos- 
pitals and clinics. The response rate was 38.1% and a total 
of 297 panoramic radiographs were collected, from which 
nine were excluded due to transmission error and 288 
were included. 

Clinical image evaluation and classification of overall 
image quality grade 

The mean of the scores given by a single specialist accord- 
ing to the Clinical Image Quality Evaluation Chart was 
79.9 (maximum possible: 100), with the highest and lowest 
scores 98 and 35, respectively. The mean and representative 
scores of each group based on the overall image quality 
grade, the last parameter, are shown in Table 3. 

In the classification of the overall image quality by the 
three evaluators, 17 images were deemed 'optimal for ob- 
taining diagnostic information,' 153 were 'adequate for 
diagnosis,' 109 were 'poor but diagnosable,' and nine were 
'unrecognizable and too poor for diagnosis' (Figs. 1-4). 

About 59.0% (170) of all the images were rated 'optimal 
for obtaining diagnostic information' or 'adequate for diag- 
nosis' (Table 4). About 96.9% (279) of the images had a 
'poor but diagnosable' or better image quality. 

The mean scores of the images with the image quality of 
'optimal for obtaining diagnostic information' and 'ade- 



lable 3. Representative values according to the overall image qual- 
ity grade 





Mean 
value 


Maximum 
value 


Minimum Standard 
value deviation 


1 


94.6 


98 


91 


1.9 


2 


85.6 


95 


74 


3.8 


3 


71.6 


80 


61 


4.7 


4 


53.6 


70 


35 


9.5 


1+2 


86.5 


98 


74 




1+2+3 


80.7 


98 


61 




1+2+3+4 


79.9 


98 


35 




1: optimal for obtaining diagnosis information, 2: adequate 
3: poor, but diagnosable, 4: unrecognizable, too poor for diaj 


for diagnosis, 
;nosis 



quate for diagnosis' were 15 points higher than that of the 
images with 'poor but diagnosable' image quality, and the 
lowest score (74 points) of the images with the 'adequate 
for diagnosis' image quality was higher than the mean 
scores of the images with a 'poor but diagnosable' image 
quality. 

Some images scored higher than the mean score of the 
images with an 'adequate for diagnosis' image quality but 
were graded with a 'poor but diagnosable' image quality 
because of the difference in their left and right contrasts 
due to inappropriate posture, a too dark or too white image, 
and an intensive burnt-out spot in the area of the inferior 
border of the mandible or soft tissue due to the intense 
contrast, though the image could be interpreted (Fig. 5). 

In particular, the panoramic images that scored 80 points, 
the highest for the images with a 'poor but diagnosable' 
image quality, were graded to have a poorer than 'adequate 
for diagnosis' image quality despite their higher score since 
it was impossible to evaluate the condylar area and the 
inferior area of the mandible because the top and bottom 
and the left and right of the image coverage were all not 
imaged, despite the good image quality of the teeth area 
(Fig. 6). 

Causes of the clinical image errors 

The results of the analysis of the causes of the errors in 
all the images are as follows (Table 5). There were 139 
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errors in the positioning, such as the patient positioning, 
patient movement, and angle of the cervical spine; 135 
errors in the processing such as an abnormal density, con- 
trast, and resolution; 50 errors from the radiographic unit 



and other mechanical problems; and 13 errors due to anato- 
mic abnormality. The total number of errors is not the same 
as the total number of images because some images had 
multiple errors and some had no errors at all. 
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fig. 4. An example of the images 
from 'unrecognizable, too poor for 
diagnosis' group. 



fig. 5. An example of the high score 
image of the 'poor, but diagnosable' 
image quality group. 



Table 4. Image quality grade classification 



Image quality grade 


Number of images 


Optimal for obtaining diagnosis information 


17 


Adequate for diagnosis 


153 


Poor, but diagnosable 


109 


Unrecognizable, too poor for diagnosis 


9 



The most common errors in the images with an 'adequate 
for diagnosis' image quality were errors in positioning 
and errors of image taking, followed by processing errors, 
mechanical errors of the radiographic unit, and errors due 
to anatomic abnormality. In contrast, images with a 'poor 
but diagnosable' image quality had more preprocessing 
errors than positioning errors. 

Nine images with an 'unrecognizable, too poor for diag- 
nosis' image quality had image errors due to the causes 
shown in Table 5; i.e., four images had positioning errors 



alone in the image taking, five images had both mechanical 
errors of the radiographic equipment and processing errors, 
and no image had errors due to anatomic abnormality. 

The errors in image taking mostly involved considerable 
deviation of the patient posture from the normal patient 
posture. The mechanical and processing errors were caus- 
ed by the irregularity in the image due to the irregular roller 
speed, abnormal exposure, and density abnormality (such 
as a too dark or too light image) that occurred all together. 

Discussion 

This study investigated the image quality of panoramic 
radiographs taken at dental hospitals and clinics across 
Korea. Clinical images were evaluated and scored using a 
Clinical Image Quality Evaluation Chart. The mean score 
of the images was 79.9 out of the highest possible score 
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Table 5. Causes of errors according to image quality grades 

Number of errors Positioning Errors from Pre-, post- Errors due to 

Image quality grade errors radiographic equipment processing errors anatomic abnormalities 

Optimal for obtaining diagnosis information 0 0 0 0 

Adequate for diagnosis 83 19 67 8 

Poor, but diagnosable 52 26 63 5 

Unrecognizable, too poor for diagnosis 4 5 5 0 

Total 139 50 135 13 




fig. 6. The highest scored image of the 'poor, but diagnosable' 
image quality group. 

of 100. Considering that 75% of the reference dose was 
used, the score would be 88, and thus, 88 points can be 
recommended. 

In addition to the evaluation using the Clinical Image 
Quality Evaluation Chart, the images were also classified 
into four grades, and 59.0% of the images had a normal 
or higher-level image quality. Considering that the mean 
score of the panoramic radiographs taken at local dental 
hospitals and clinics based on the image quality evaluation 
was 79.9 points, which is higher than the lowest score (74 
points) of the images with a normal image quality, and 
that more than half of the images had a normal or higher- 
level image quality, the image quality of the panoramic 
radiographs taken at local dental hospitals and clinics had 
a normal or higher-level image quality. 

On the Clinical Image Quality Evaluation Chart, the 
necessary parameters to be fulfilled should be pointed out 
clearly in order to prevent 'unrecognizable, or too poor for 
diagnosis' images from achieving scores above the refer- 
ence level. The parameters that need to be met must be 
selected, and the images should be graded as 'unrecog- 
nizable and too poor for diagnosis' when the necessary 



parameters are not met regardless of the results for the 
other parameters. In this study, we tried to solve this pro- 
blem by including the overall image quality grade in the 
Clinical Image Quality Evaluation Chart. 

The images with an overall image quality grade that was 
lower than the scores based on the Clinical Image Quality 
Evaluation Chart had errors due to the following: as des- 
cribed in the Results section, the top and bottom and the 
left and right sides cut from the area of the image; the inter- 
pretation of the anterior teeth area was impossible due to 
malpositioning; and there was severe contrast abnormality 
due to a too dark or too white image. These factors have 
greater influence on the image quality than other factors 
and can thus be considered parameters that need to be met. 

Also, in many cases, the cause of the error was not con- 
sistent among the three images sent from each hospital or 
clinic. The causes were as follows: (1) the patient age and 
body condition were different; (2) the patient positioning 
was not uniform during the image taking; and (3) even if 
the patient positioning was appropriate, the conditions of 
the radiographic unit could have been different if the images 
were taken on different days. 

The cause of the error differed by grade. For the images 
with an 'adequate for diagnosis' image quality, positioning 
errors in the image taking were most common, followed 
by preprocessing errors, radiographic camera errors, and 
errors due to anatomic abnormality. In contrast, for the 
images with a 'poor but diagnosable' image quality, pre- 
processing errors were more common than positioning 
errors. This could have been due to the following: during 
the image taking, such devices as the bite block, chin rest, 
and head rest were used to fix the patient's head so as to 
minimize the possibility of a positioning error, whereas 
the processing error is attributable to mechanical and soft- 
ware problems and thus, the range of problems is unlimited. 

This indicates that processing problems have a worse 
effect on the interpretation of the image than positioning 
errors. As such, the results of the analysis of the errors 
indicated that management and training of relevant person- 
nel and inspection of facilities are required. 
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This study is meaningful because it is the first study that 
investigated the current status of panoramic radiographs 
taken at local dental hospitals and clinics and that evaluated 
the quality of clinical images to promote quality assurance 
in panoramic radiography. 

In conclusion, panoramic radiographs taken at local den- 
tal hospitals and clinics generally have a normal or higher- 
level image quality. Principal factors affecting image qua- 
lity were, namely, positioning of the patient and image 
density, sharpness, and contrast. Therefore, when images 
are taken, patient position should be adjusted with great 
care. Also, standardizing objective criteria of image den- 
sity, sharpness, and contrast would be required to evaluate 
image quality effectively. Images with a below-normal 
image quality are not adequately addressed, however, 
because of lack of regulations on equipment and image 
quality assurance in panoramic radiography. Currently, in 
the beginning stage of panoramic radiography, quality 
assurance systems for dental radiography are being pre- 
pared, and specialists of the Korean Academy of Oral and 
Maxillofacial Radiology, the main body for dental radio- 
graphy, are actively participating in quality assurance de- 
velopment and implementation. Guidelines are needed on 
image quality management for panoramic radiography to 
promote public health and reduce medical costs. 
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